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"q | Abstract 

The model of cellular automata is fascinating because very simple local rules can 
generate complex global behaviors. The relationship between local and global function 
is subject of many studies. We tackle this question by using results on communication 
complexity theory and, as a by-product, we provide (yet another) classification of 
cellular automata. 

c/3 ! 

l^: 1 Introduction 

The model of cellular automata was invented in the 1950's mostly by von Neumann as a 
tool to study self-reproduction (see |[vN67|| ). It was then meant both as a tool to model real 
life dynamical systems and as a model of an actual computer. Since then cellular automata 
are studied theoretically either as a model of massive parallel computation or as a discrete 
dynamical system. They are also studied experimentally either as a tool to model complex 
natural systems ranging from economy, geology, biology, chemistry, sociology, etc or as a 
framework to do simulations. For a general introduction, see |pM99| . 

A cellular automaton is an infinite and discrete grid of cells. Each cell contains at every 
| time step a particular state from a finite set. The cell state obeys a local rule, mapping its 
state and the state of the neighborhood to a new cell state. This rule is applied uniformly 
and synchronously to all cells of the grid. So the local rule generates a global mapping on 
grid configurations, which can be quite complex. For example, some simple local rules give 
computation universal cellular automata. 

It is an important issue to understand the relationship between local and global mappings. 
In this paper we view a cellular automaton as a grid of communicating cells. During the 
evolution information can flow through the whole grid. In one- dimensional cellular automata 
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a fixed cell divides the grid into two parts and we are interested in the way information flows 
through the cell. By studying the communication complexity of successive iterations of the 
local function we provide a new way to look at the global behavior of cellular automata. 

2 Elementary cellular automata and — 1 matrices 

In this paper we mainly focus on elementary cellular automata (ECA) which we define 
hereafter, although generalization to any one-dimensional cellular automata (CA) is always 
possible and quite straightforward. 

We consider the one-dimensional cellspace, where each cell can be either in state or in 
state 1. An ECA is defined by a local function / : {0, l} 3 — > {0, 1} which maps the state of 
a cell and its two immediate neighbors to a new cell state. There are exactly 2 2 " = 256 ECA 
and each of them is is identified with its Wolfram number, which is between and 255 and 
defined as 

(±a + 2b + c)f(abc). 

a,fe,cG{0,l} 

Following the cellular automata's paradigm, all the cells change their states synchronously 
according to the local function. This endows the line of cells with a global dynamics whose 
links with the local function are still to be understood in the general case as already pointed 
out in the introduction. Let us remark however that some simple transformations on the 
local function induce simple transformations on the global dynamics: the space-symmetric 
ECA of / is the ECA /' with f'(a, b, c) = f(c, b, a) and the state-symmetric is the ECA /" 
with f"(a, b, c) = f(a, b, c). Thus we consider only ECA whose Wolfram number is minimal 
among its symmetries. This leaves 88 out of 256 ECA to consider, which is more than 256/4 
because some ECA are symmetric. 

To tackle the issue of local/global relationships, we study the evolution of one cell's state 
after finitely many time steps. Given that after n time steps the value of a cell depends 
on its own initial state and the initial states of the n immediate left and n immediate right 
neighbor cells, we define the n-th iteration of /, f n : {0, l} 2ri+1 — > {0, 1}, as f 1 = f and for 
n > 2 as 

/ (■£— ni • • • i li •£()) Xi, . . . , Xn) / (/ ni • • • i -^n— 2) j 

/ (X— n+lj • • • 1 X n — 1), 
f n 1 (x_ n+ 2, . . . , £ n )) • 

Notice that knowing a simple description of f n for arbitrary n is knowing the long term 
(asymptotic) behavior of the whole line of cells. 

We therefore propose to measure the complexity of an ECA / by the asymptotic com- 
plexity of the functions (/"). For that purpose, — 1 matrices reveal themselves to be a 
striking representation. When fixing the state of the central cell among 2n + 1 adjacent ones 
to for instance, 2 2n initial configurations are possible each leading the central cell to a 
peculiar state after n time steps. This can be summarized in a square matrix Mq of size 2™ 
defined as follows: 

MX(i,j) :=f n (ko,b 3 ) 
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where is the binary representation of the integer k on exactly n bits, and b^ its reverse 
representation. Each value n defines a different matrix, and we have, for each ECA, an 
infinite family of binary matrices for n — 1, 2, . . .. 

Note that the definition of Mq is unique up to permutation of rows and columns. We 

could as well have defined Mq '■= f n (bi,0,bj) for example. 

Fixing the center cell to was arbitrary. We could as well have chosen 1. Therefore, 
any ECA / defines two families of binary matrices (see figure |l|) . Note that the first matrix 
of each family, standing for n = 1, defines completely the local function. One can think of 
these matrices as seeds for the families. 
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Figure 1: The two families of binary matrices M™ of Wolfram rule 54 cellular automata 



The matrices can in some cases ease the understanding of the global behavior. In figure ||] 
we show the space time diagram of rule 105 for some arbitrary configuration, and on the 
right the matrix Mq. In contrast with the space-time diagram, the matrix looks simple, 
and indeed there is a small description of the additive rule 105 (which is given later in the 
paper). We should emphasize that the space-time diagram shows the evolution of only a 
single configuration, while the matrix covers all configurations. 
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Figure 2: A space time diagram for rule 105 (left) and one matrix of its families (right). In 
the diagram every row is a configuration and time goes upward. It shows only those cells, 
on which the upper center cell depends. 

Different measures on the matrices are possible in order to analyze the underlying ECA. 
Among them we choose the simplest one: the number of different rows. To be precise we 
define d n as the maximum of the 4 following integers: number of different rows of Mq, 
number of different columns of M^, number of different rows of M™, number of different 
columns of M™. 
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3 Experimental measuring 



Since the family of matrices of a given ECA defines the global and long term behavior, we can 
express d n as a known function of n only once we understood the global behavior. However 
in some cases, seeing the matrices helped us to understand the global function. 

We did brute force computations in order to compute d n for n G {1, . . . , 12} and for all 
ECAs. The complete results are shown in the web page www.lri.fr/~durr/CACC/. Figure |3] 
plots d n for different rules. We obtain quite different sequences, which we classify as follows: 

Bounded: there is b G N such that Vn : d n < b. 

Linear: there are values a G N and a x G Q such that d n = [ain\ + a , for all n > n for 
some fixed value no. 

Other: in this class we put rules where non of above applies. In some cases d n seems to be 
bounded by a polynomial in n, and in some cases d n seems to be exponential. 




2 4 6 8 10 



Figure 3: Different sequences d n . 

We want to emphasize that this classification is mainly experimental. Most of the time we 
don't have mathematical evidence for determining whether a rule belongs to one class rather 
than to another. Table [l] shows the classification of all rules (again, only up to symmetric 
transformations which preserve d n ). 

The following sections are devoted to the few ECA where we were able to give a closed 
formula for d n making their classification rigorous. 



4 Communication complexity 

The communication complexity framework appears as an extremely useful tool for calculating 
d n . The communication complexity theory studies the information exchange required by 
different actors to accomplish a common computation when the data is initially distributed 
among them. To tackle that kind of questions, A.C. Yao [|Yao79|| suggested the two-party 



model: two persons, say Alice and Bob, are asked to compute together the values taken 
by a function / of 2 variables (x and y taking values in a finite set), Alice always knowing 
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Bounded: 0, 1, 2, 3, 4, 5, 7, 8, 10, 12, 13, 15, 19, 24, 27, 28, 29, 32, 34, 36, 38, 42, 46, 51, 
60, 71, 72, 76, 78, 90, 105, 108, 128, 130, 136, 138, 140, 150, 154, 156, 160, 170, 172, 
200, 204 

Linear: 11, 14, 23, 33, 35, 43, 44, 50, 56, 58, 77, 132, 142, 152, 168, 178, 184, 232 

Other: 6, 9, 18, 22, 25, 26, 30, 37, 40, 41, 45, 54, 57, 62, 73, 74, 94, 104, 106, 110, 122, 126, 
134, 146, 164 



Table 1: A classification of EC As 



the value of x only and Bob that of y only. Moreover, they are asked to proceed in such a 
way that the cost — the total number of exchanged bits — is minimal in the worst case. 
Now different restrictions on the communication protocol lead to different communication 
complexity measures. 

Definition 1 (Many round communication complexity). The many round communi- 
cation complexity CC(f) of a function / is the cost of the best protocol for /. 

Definition 2 (One-way communication complexity). A protocol is AB-one-way if only 
Alice is allowed to send information to Bob, and Bob has to compute the function solely 
on its input, and the received information. The AB-one-way communication complexity is 
the worst case number of bits Alice needs to send. BA-one-way complexity is defined in the 
same manner. Finally, the one-way complexity C(f) of / is the maximum of its AB-one-way 
and BA-one-way complexities. 

Whereas most studies concern the many round communication complexity, we focus only 
on the one-way communication complexity. In terms of cellular automata it will permit us 
to measure the amount of information which have to flow from one side to another. Also 
from a practical point of view, the former measure is extremely difficult to compute for most 
functions, while the last measure is quite easy as shown by the next fact. 



Fact 3 ( |[KN97|| ). Let f be a binary function of2n variables and Mf G {0, 1} 2 ™ X2 ™ its matrix 
representation, defined by Mf(x,y) = f(xy) for x,y G {0, l} n . Let d{Mf) be the maximum 
of the number of different rows and the number of different columns in Mf . We have 

C(f) = \log 2 {d(M f ))] . 

Proof. Let be a AB-one-way protocol, where Alice knows x G {0, l} n and Bob y G {0, 1}™. 
Suppose Alice sends to Bob at most k bits which depend solely on x, say by some mapping 
g : {0, 1}™ — ► {0, l} fc . Then since Bob knows f(x,y) only from y and g(x), we must have 
f(x,y) = f(x',y) for all x,x' with g(x) = g{x'). In terms of matrix representation it means 
that the rows in Mf indexed by x and x' are the same. So we must have k > |~log 2 (d(M/))] . 

Conversely, [log 2 (d(M/))] are sufficient for Alice: knowing Mf she only has to say to 
Bob the group of identical rows the current entry belongs to. □ 
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Then, up to a log transformation, the complexity measure d n appears to be precisely the 
exchanged information amount required for Alice and Bob to compute f n when Alice has 
the n left cells and Bob has the n right cells, both knowing the value of the central cell and 
maximizing over the scenario where only Alice is allowed to talk, and the scenario where 
only Bob is allowed to talk. 



5 ECA with bounded complexity 

We will now give formal proofs for some ECA to be in the bounded complexity class. 

Definition 4. An ECA is nilpotent if it converges to a unique configuration from any initial 
configuration in finite time. 

Given that an ECA / is nilpotent if and only if there is uq such that f n is constant 
for all n > no, it is clear that a nilpotent ECA will have d n — 1 for large enough n: no 
communication is needed between Alice and Bob to compute the final state of the central 
cell. 

There is a natural condition generalizing nilpotency, which can be used to prove bounded 
complexity for ECA. 

Definition 5. An ECA / has a limited sensibility if the number of cells f n actually depends 
on is bounded by a constant independent of n. Formally there is a constant c such that Vn 
3w e {0, l} 2n+1 with Y^t 1 Wi<c and f n (u) = f n (u A w) for all u e {0, l} 2n+1 where A is 
the bitwise boolean and. 

The ECA has half-limited sensibility if the condition above holds for the weaker condition 
Yn=i Wi< cor equivalently Y^t+i w i - c - 

Clearly if / has limited sensibility c at most c bits need to be exchanged between Alice and 
Bob. We show now that the half-limited sensibility is enough to achieve bounded one-way 
communication complexity. 

Lemma 6. An ECA with half-limited sensibility is in the bounded complexity class. 

Proof. Without loss of generality, let us assume that Alice knows the left cells and that the 
sensibility of f n is limited by c on the first n cells. There is a trivial AB-one-way protocol 
of cost c. We give a BA-one-way protocol of cost 2 C , which is worse but still constant. Bob 
successively guesses each possible value of Alice's sensible cells and sends the list of the 
corresponding values for f n . Then Alice select among this list, the entry corresponding to 
the actual values of its sensible cells. □ 

An interesting example is rule 60. It has sensibility on the second half, and unlimited 
sensibility on the first half, as it computes the parity of the first n + 1 cells, whenever n + 1 
is a power of 2. 

Unfortunately, it is undecidable to determine whether a given CA has a limited sensibility 
(by reduction from the nilpotency problem which is undecidable [ Kar92|| ). Except some 



particular examples, we can only guess if a ECA has limited sensibility based on brute force 
computation for small values of n. 
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However there is a decidable property, which is sufficient for a ECA to be in the bounded 
class. 



Definition 7. An ECA / is additive is there are binary operators © and © (not necessarily 
distinct), and a neutral element e such that for all X^ X © 6 — 6 © X — X and with 



Var, y, z, x', y', z 1 



f(x ®x',y® y', z®z')= f(x, y, z) © f(x', y', z') 
f{x ®x',y® y', z®z')= f(x, y, z) © f(x', y', z') 



Remark. The previous definition can naturally be extended to longer operator chains. How- 
ever, as far as ECA are concerned, 2 operators are sufficient to capture all additive rules. 

Additivity is preserved by iterations of the local rule, as stated in the following lemma 
which can be proved straightforwardly by induction on n. 



Lemma 8. For all integer n we have Vit, u' £ {0, l} 2n+1 : 
/>©«') = 

f n {u®v!) = 



f n (u) © f n {v!) if n is odd, 

f n (u) © f n {u') otherwise, 

f n (u) © f n (u') if n is even, 

f n (u) © f n (u') otherwise. 



where © and © act bitwise on bitstrings. 
Property 9. If f is additive, d n is bounded by 2. 

Proof. Let / be additive for © and © with the neutral element e. We give a one-way protocol 
computing f n , where Alice sends a single bit to Bob, who can then compute the function. 
Bob could have started as well in this protocol. Let c be the state of the central cell and u 
and v the states of the n left cells and n right cells. Alice knows u, c; Bob knows v, c; and 
the goal is to compute f n {u, c, v). The protocol is the following: 

1. Alice computes the single bit b = f n (u, c,,e_^_e,) and sends it to Bob; 

n 

2. then Bob computes 

b © f n (^_^_e / , c, v) if n is even 

n 

b © f n (§_^_ 5) c, v ) if n is odd. 

n 

By Lemma |8] the protocol is correct. □ 

As an example we consider the additive rule 105. In the following table we write its local 
function f(x,y,z) above all combinations of x,y,z. By the way, note that by definition of 
Wolfram numbers, the first row contains the number 105 in reverse binary notation. 

10 10 110 

000 001 010 01 1 100 101 1 10 111 
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The local function can be written as 

f(x,c,y) = x@c®y@l, 

where © is the exclusive or. Given that © is associative, commutative and admits a neutral 
element (0), the rule clearly fits definition [7]. This explains why the matrices M™ have only 
two different rows or columns, as depicted in figure [| 

These observations permit us to refine the class of ECA having bounded complexity, 
and distinguish the following cases. Note that the first subclass is rigorous as it is based on 
proven properties of the local function, while limited sensibility is mostly based on brute force 
computation. The last subclass contains ECA for which we were not able to give a general 
reason for their membership to this class, although some of them are easy to understand 
individually (for instance, rule 32). 

bounded by additivity 15, 51, 60, 90, 105, 108, 128, 136, 150, 160, 170, 204 

bounded by limited sensibility 0, 1, 2, 3, 4, 5, 8, 10, 12, 19, 24, 29, 34, 36, 38, 42, 46, 

72, 76, 78, 108, 138, 200 

bounded by half-limited sensibility 7, 13, 28, 140, 172 
bounded for any other reason 27, 32, 130, 156, 162 

6 ECA with linear complexity 

The case of linear complexity illustrates very nicely the relationship between communication 
complexity and ECA. We would like to emphasize on the fractal structure of the matrices 
for some rules, see figure £|. For those matrices the number of different rows is logarithmic 
in the size of the matrix, which makes it linear in n. 
As an example we consider rule 132: 

1 1 

000 001 010 01 1 100 101 1 10 111 

Figure |5| shows the fractal structure of its matrices. The space time diagram gives an 
explanation. Any block consisting of several l's, shrinks at every time step by 1 at each end, 
and either vanishes or remains a single 1, depending on the parity of its length. 

Lemma 10. For rule 132 we have d n — n + 1. 

Proof. For an upper bound we give a very simple communication protocol. If the center is 0, 
no communication at all is needed, as the answer will always be 0. Now suppose the center 
is 1. It is part of a block consisting of k cells on Alice's side, and of / cells on Bob's side, 
where < k, I < n. Now Alice sends k to Bob, and Bob answers 1 if k = I and otherwise. 
The protocol is correct, since after n steps the center will remain 1 only if it is in the center 
of an even length block or if it is distant by at least n to each end of the block. For the 
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rule 33 rule 44 rule 50 rule 164 




rule 14 rule 35 rule 168 rule 184 

Figure 4: Matrices of some ECA with linear complexity. The first row shows matrices with 
striking fractal structure. 




Figure 5: A space time diagram for rule 132 (left) and one matrix of its families (right). 
Note that in this matrix the lower right quadrant has the same structure as the matrix itself. 



protocol, Alice needs to send a number out of n + 1 different values. It would be the same 
if Bob starts first. Therefore d n < n + 1. 

For the lower bound, we give a submatrix in Mq which is the identity. This submatrix is 
of dimension (n+1) x (n+1), which will show that there are at least n + 1 different rows and 
at least as must different columns. Let Rk be the row in Mq corresponding to n ~ k l h , and 
let Ci be the column corresponding to l l n ~ l . The submatrix made up of the intersection of 
rows Rk and columns C\ for < k, I < n is the identity matrix. □ 

This example is also interesting because the number of different rows in is 1 if c = 
and n + 1 if c = 1, while for most rules the number of different rows seems to be the same 
(or at least similar) for the two families of matrices. 

Another example is rule 23: 

1110 10 

000 001 010 01 1 100 101 1 10 111 

In this rule, cells become alternatively and 1 with exception of those being inside a 
block of alternating 0's and l's. Since the neighboring cells of such a block alternate their 
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Figure 6: A space time diagram for rule 23 (left) and one matrix of its families (right). Note 
that there is a square in the matrix, smaller by 1/4 in height and width which has the same 
structure as the matrix itself. 

states, a block shrinks at both ends by 2 cells every second time steps. One can apply the 
same method to prove d n — n + 1. 

7 ECA with other complexity 

The ECA of this class are not well understood yet. For example, it contains rules 110 and 
54, which are conjectured to be computation universal.[] However for larger cell states we 
were able to prove polynomial and even exponential complexity for some CA. 

The following CA with 3 states has quadratic complexity and the construction can be 
generalized for more states to achieve complexity Q(n k ) for any k. 

Let be the state set {0, 1, 2}. The cellular automata is defined for all i,j, k by 

f (- ■ t,\ _ / j if 3 — and i = k, 

[ vaeoc{i,j,k} otherwise. 

Note that each state is quiescent. The global behavior can be explained like this (see 
figure 0). Every cell different from tends to expand in both directions. Whenever a 1- 
expansion and a 2-expansion meet, the 2-expansion overrules the former. There is a single 
situation where a cell can remain 0, it is when two expansions of the same state reach at 
the same time the left and right neighbor. 

To make this statement formal, consider the cell at position 0. Let r 2 be the position 
of the first state- 2-cell on the right between 1 and n, and oo if there is no such cell. Let r\ 
be the position of the first state-l-cell between 1 and r2 — 1 and oo if there is no such cell. 
The positions l\, I2 are defined in the same manner for the left neighborhood. Now we can 
completely determine the cell state after n steps. 

• If the cell was in state 2, then it remains 2 forever. 

• If the cell was in state 1, then it remains 1 after n steps if and only if l 2 < —n and 

n < r 2 . 

1 Rule 110 has been proven universal in some sense by M. Cook who presented his results during the 
CA98 workshop at Santa Fe Institute. The result is also presented in the book "A New Kind of Science" by 
S. Wolfram . But as far as we know a complete and detailed proof doesn't appear in any reference. 
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Figure 7: A space time diagram for the 3-state CA, where 0=white, l=gray, 2=black (left) 
and one matrix Mq of its families (right). 



• If the cell was in state 0, then it remains after n steps if and only if (l 2 < — n and 

n < r 2 or —l 2 = r 2 ) and (li < —n and n < r\ or — l x = ri). 

From these observations we can determine its complexity. 
Lemma 11. The complexity of the CA defined above is d n G 0(n 2 ). 

Proof. We will construct Q(n 2 ) different rows in the matrix Mq, which will suffice for the 
lower bound by symmetry of the matrix. For every < j < i < n let be Rij the row 
corresponding to the left neighborhood 

n—i i—j j 

Let be Cij the column corresponding to the similar (reversed) right neighborhood. Then 
row Rij is only at column C it j, showing that all rows R it j are different. 

Conversely for the upper bound, it is clear from the above description of the rule that 
a correct one-way communication protocol can be achieved with complexity 2[log 2 (r2, + 1)], 
since Alice needs only to send the numbers h,l 2 to Bob, while each can have only n + 1 
different values. □ 

We show now a very well known and simple CA, which has exponential complexity. 

Let be state set {0,1,0,1}. We define the cellular automata / such that f n (u,l,v) 
compares the strings u and v, with u G {0, 1} and v G {0, 1}. Let be x,c,y G {0, 1} and 
z G {0,1,6,1}, then 



f(x,i,y) 



f(z,c,y) = y 

f(x,c,y) = x 

1 if x — y 
if x ^ y 



(shift left to the center) 
(shift right to the center) 

(a difference makes the center 0) 



For all other values / is 0. 

Lemma 12. The complexity d n of the CA defined above is exponential in n. 

Proof. Clearly contains at least 2 n different rows (among 4 n ) : for every row indexed by 
u G {0, 1}™ there is a single entry 1, at a column v, where v is the reverse dual of u, and any 
other row contains only 0. □ 
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8 Future directions 



The purpose of this paper was to show a relationship between cellular automata and com- 
munication complexity. For this we deliberately made simple choices: elementary cellular 
automata and particular one-way communication. Our approach can be generalized in sev- 
eral ways: 

• We partitioned evenly the In + 1 cells between Alice and Bob, and also fixed the 
center cell. This does not take into account asymmetric behavior for some CA. When 
f n is fixed, we can define a matrix representation M™ of dimension 2 P x 2 2n+l ~ p (for 

1 < p < 2n + 1) such that Mp(u,v) = f(u v), i.e. where Alice knows the p leftmost 
cells and Bob the n — p rightmost. Then an interesting complexity measure is: 

R n = max \rows(M™)\, 
v 

where |rows(-)| stands for the number of different rows. The value of p where the 
maximum is reached is non trivial and, while clearly connected to the global behavior, 
hard to predict from the local rule. A striking example is ECA rule 7 which has a 
bounded d n complexity due to its half-limited sensibility but has a linear R n complexity, 
maximum being reached around p — |, as indicated by brute force computations. 

Following this idea, we could as well define R n symmetrically on rows and columns as 
follows: 

R n = max max { | rows (M£)\, \cols(M£)\} . 

• The link between communication complexity and matrix representations is not reduced 
to Fact H Actually, many round communication complexity is lower-bounded by the 
log of the rank of the matrix representation (see ||KN97|| ) . Moreover, it is conjectured 
that a poly-log of the rank is also an upper-bound. 

• Finally, considering the more general framework of all one-dimensional CA (with any 
radius and any state set), it is interesting to note that a classification based on the 
asymptotic behavior of d n has some very reassuring properties such as: 

— the class of a CA A is "higher" than the class of any of its sub-CA ; 

— the complexity of the Cartesian product Ax B is the product of the complexities 
of A and B. 

Another important issue of course, is to give mathematical rigorous proofs for the complexity 
of some ECA, which however is at least as difficult as understanding completely the global 
behavior. 



9 Acknowledgment 

We would like to thank Nicolas Ollinger for helpful discussions. 



12 



References 

[DM99] M. Delorme and J. Mazoyer, editors. Cellular Automata. Kluwer Academic Pub- 
lishers, 1999. 

[Kar92] J. Kari. The nilpotency problem of one- dimensional cellular automata. SIAM J. on 
Computing, 21:571-586, 1992. 

[KN97] E. Kushilevitz and N. Nisan. Communication Complexity. Cambridge, 1997. 

[vN67] J. von Neumann. The theory of self reproducting cellular automata. University of 
Illinois Press, Urbana, Illinois, 1967. 

[Yao79] A.C. Yao. Some complexity questions related to distributed computing. In Proc. of 
11th ACM Symposium on Theory of Computing, pages 209-213, 1979. 



13 



